Rater Certification Tests: A Psychometric Approach

Autor/in	Attali, Yigal
Titel	Rater Certification Tests: A Psychometric Approach
Quelle	In: Educational Measurement: Issues and Practice, 38 (2019) 2, S.6-13 (8 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Attali, Yigal)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0731-1745
DOI	10.1111/emip.12248
Schlagwörter	Evaluators; Certification; High Stakes Tests; Scoring; Decision Making; Test Reliability; Test Construction; Test Use + Suchen Sie Ihr Suchwort? Abschlusszeugnis; Zertifizierung; Bewertung; Decision-making; Entscheidungsfindung; Testreliabilität; Testaufbau; Testanwendung
Abstract	Rater training is an important part of developing and conducting large-scale constructed-response assessments. As part of this process, candidate raters have to pass a certification test to confirm that they are able to score consistently and accurately before they begin scoring operationally. Moreover, many assessment programs require raters to pass a calibration test before every scoring shift. To support the high-stakes decisions made on the basis of rater certification tests, a psychometric approach for their development, analysis, and use is proposed. The circumstances and uses of these tests suggest that they are expected to have relatively low reliability. This expectation is supported by empirical data. Implications for the development and use of these tests to ensure their quality are discussed. (As Provided).
Anmerkungen	Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01